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★ PHIG T04 92-391571/48 ★ EP 514975- Al 

Manipulation and placement of component on printed circuit board - 
using camera to determine relative positions of manipulator and 
component to guide component into correct position on board (Eng) 

PHILIPS GLOEILAMPENFAB NV 91.05.21 91EP-201206 

V04 X25 (92.11.25) H05K 13/08 
92.05.12 92EP-201352 R(DE FR GB) 

The method involves displacing a manipulator (23) carrying a 
component relative to an imaging device so that the component is 
brought into an image field of the video camera (25). The position of 
the component is determined by the camera and located by the 
manipulator. 

A picture of the component and reference member coupled to 
the manipulator is made by the camera, after which the positions of 
the component and the manipulator relative to the image device are 
determined. 

ADVANTAGE - Permits correct high speed placement of 
component on PCB. Eliminates positioning inaccuracies during 
quick movements. (lOpp Dwg.No.1/6) 

CT: DE3546216 EP284381 EP350850 EP394568 EP432848 EP434156 

US4472056 US4553843 
N92-298673 T04-D07D5 
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0 Methods of placing a component on a printed circuit board, and device suitable for carrying out 
said methods. 
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@ A method of placing a component on a printed 
circuit board by means of a manipulator and a 
device suitable for carrying out this method, where- 
by the position of the component is determined with 
an imaging device. The imaging device makes a 
picture of the component and of a reference mem- 
ber coupled to the manipulator. The position of the 
component relative to the manipulator can be di- 
rectly determined from this picture. The positions of 
the manipulator and the component relative to the 
imaging device may also be determined. 
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The invention relates to methods of placing a 
component on a printed circuit board whereby a 
manipulator carrying the component is displaced 
relative to an imaging device and the component is 
brought into an image field of the imaging device, 
after which the position of the component is deter- 
mined by means of the imaging device and subse- 
quently the component is put in the correct position 
on the printed circuit board by the manipulator. The 
invention also relates to a device provided with an 
imaging device and at least one manipulator dis- 
placeable relative to the imaging device. 

A method of the kind mentioned in the opening 
paragraph and a device for carrying out said meth- 
od are known from German Patent A1 3546216. In 
this known method, an electronic component (chip) 
is transported to a feed position by a supply de- 
vice. In this feed position, a manipulator controlled 
by a control system pick up the component by 
means of an underpressure and moves it into an 
image field of an imaging device. A picture of the 
component is then taken by means of the imaging 
device. In an image signal processor, this picture is 
compared with a model picture of the component 
stored in this processor, and deviations in an x- 
and a y-direction and an angular deviation about a 
z-axis are computed. An x-axis and a y-axis, which 
define the x- and y-directions, lie in a plane parallel 
to the printed circuit board on which the compo- 
nent is to be placed. The z-axis is directed trans- 
versely to this plane and coincides with an axis of 
rotation of the manipulator. After the deviations 
have been computed, the component is rotated 
through an angle by the manipulator and is put in 
the desired position on the printed circuit board, 
during which the computed deviations are taken 
into account. During imaging of the component it is 
necessary for the manipulator to be in a position 
relative to the imaging device which is known be- 
forehand. The position of the manipulator is deter- 
mined by the control system. If the manipulator 
moves at a certain speed relative to the imaging 
device during imaging, the exact position of the 
manipulator at the imaging moment cannot be ac- 
curately determined by means of the control sys- 
tem. A disadvantage of this method and of this 
device is that, if the manipulator position relative to 
the imaging device deviates from the expected 
position, the position of the component relative to 
the imaging device cannot be well determined, and 
faulty corrections will be carried out. For example, 
if the component is picked up eccentrically by the 
manipulator, a rotation about the z-axis will cause 
deviations in the x- and y-directions. If the position 
of the manipulator relative to the imaging device is 
known, these deviations can be corrected during 
placement on the printed circuit board. If this posi- 
tion is not accurately known, these deviations can- 


not be corrected. 

The invention has for its object to provide a 
method by which the positions of the component 
and of the manipulator can be accurately deter- 

5 mined in such a way that a correct placement on 
the printed circuit board is possible. 

The method according to the invention is for 
this purpose characterized in that a picture of the 
component and of a reference member coupled to 

w the manipulator is made by means of the imaging 
device, after which the positions of the component 
and the manipulator relative to the imaging device 
are determined from this picture. These positions 
are compared with expected positions relative to 

/5 the imaging device. Subsequently, the manipulator 
is moved to above the printed circuit board, during 
which the deviations are taken into account, and 
then the component is placed on the printed circuit 
board in the desired position. 

20 The invention also has for its object to provide 

a method by which the position of the component 
relative to the manipulator can be accurately deter- 
mined in such a way that a correct placement on 
the printed circuit board is possible. 

25 The method according to the invention is for 

this purpose characterized in that a picture of the 
component and of a reference member coupled to 
the manipulator is made by means of the imaging 
device, after which the position of the component 

30 relative to the manipulator is determined from this 
picture. This relative position is compared with an 
expected relative position, and deviations in the x- 
and y-direction and an angular deviation about the 
z-axis are computed therefrom. The manipulator is 

35 then moved to the desired position above the print- 
ed circuit board, during which the deviations are 
taken into account, and then the component is 
placed on the printed circuit board in the desired 
position. The position of the manipulator relative to 

40 the imaging device must be such that the compo- 
nent and the reference member are in the image 
field of the imaging device during imaging. The 
exact position of the imaging device is immaterial 
in this method. 

45 It is noted that European Patent A2-0350850 

discloses a method and a device where a camera 
is connected to a manipulator and makes a picture 
of the component and of a background which 
moves along with the camera and is provided with 

so marks. In this device, the position of the manipula- 
tor relative to the camera is unequivocally known 
and the problem of determining the component 
position relative to the manipulator instead of the 
component position relative to the camera plays no 

55 part. A disadvantage of this device is that the 
camera moves along whenever the manipulator is 
displaced. The weight of the camera causes posi- 
tioning inaccuracies during quick movements. An- 
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other disadvantage is that the use of a number of 
manipulators implies that each manipulator must be 
provided with a separate camera, so that a very 
expensive device is obtained. 

An embodiment of the method according to the 5 
invention is characterized in that a picture is made 
by the imaging device while the component carried 
by the manipulator and the reference member 
coupled to the manipulator are being moved 
through the image field of the imaging device. This w 
increases the speed at which the component is 
placed on the printed circuit board. The manipula- 
tor may be moved through the image field of the 
imaging device at any speed desired. 

The invention also has for its object to provide ;s 
a device by which the disadvantage of the known 
device is obviated- The device suitable for carrying 
out the method according to the invention is for this 
purpose characterized in that the device is pro- 
vided with a reference member which is coupled to 20 
the manipulator. This reference member has a 
fixed position relative to the manipulator. As a 
result, the position of the manipulator is known if 
the position of the reference member has been 
determined by the imaging device. The position of 25 
the component relative to the reference member 
can also be determined, upon which the position of 
the component relative to the manipulator is known. 

An embodiment of the device according to the 
invention is characterized in that the device is 30 
provided with a number of manipulators, while the 
reference member is a common reference member 
which is coupled to all manipulators. The use of a 
number of manipulators increases the speed at 
which components can be placed on a printed 35 
circuit board. The use of a common reference 
member for all manipulators has the advantage that 
all manipulators can be coupled to a reference 
member in a simple manner. 

Another embodiment of the device according 40 
to the invention is characterized in that the refer- 
ence member comprises a plate which is provided 
with at least one mark. The mark may be a white 
square which is provided on a black plate so as to 
obtain a good contrast. An inexpensive reference 45 
member is obtained in this way which may be 
added in a simple way to an existing component 
placement device, such as, for example, the one 
described in the German Patent A1 3546216. 

A further embodiment of the device according so 
to the invention is characterized in that the refer- 
ence member comprises a number of legs. Such a 
reference member is suitable in a device which is 
also provided with an imaging device which com- 
prises at least one light source and a light sensor 55 
cooperating with said light source and which is 
suitable for placing components having connection 
wires. The legs of the reference member coupled 


to the manipulator and the connection wires of the 
component interrupt a light beam emitted by the 
light source in the direction of the light sensor at 
different moments. The position of the component 
relative to the manipulator can be determined from 
these moments. Such an imaging device is known 
from US Patent 4553843. 

The invention will be explained in more detail 
with reference to the drawing in which 

Fig. 1 is a diagrammatic side elevation of a 

device according to the invention, 

Fig. 2 is a diagrammatic plan view of the device, 

Fig. 3 shows a pick-up device with a number of 

manipulators of the device, 

Fig. 4 is a bottom view of the pick-up device 

depicted in Fig. 3, 

Fig. 5 shows a component with a reference 
member according to the invention, 
Fig. 6a diagrammatically shows a second em- 
bodiment of a device according to the invention, 
and 

Figs. 6b and 6c are a plan view and a lateral 
elevation, respectively, of an imaging device be- 
longing to the device shown in Fig. 6a. 
The same reference numerals are used for the 
corresponding parts in the various Figures. 

Figs. 1 and 2 show a device 1 for placing 
components on a printed circuit board in lateral 
elevation and in plan view, respectively. The refer- 
ence numeral 2 in these Figures indicates a printed 
circuit board which has already been provided with 
components 3 at the lower side, which components 
have been placed in holes in the printed circuit 
board 2 with their connection wires. The printed 
circuit board 2 is supported by a carrier 5. Compo- 
nents are yet to be placed on the upper side of the 
printed circuit board 2. These may be: components 
suitable for surface mounting, the so-called SMDs 
such as PLCCs, QFPs, SOTs, etc., or components 
having connection wires which are to be inserted in 
holes in the printed circuit board 2. The compo- 
nents must be placed on the printed circuit board 2 
in an accurate manner with small mutual inter- 
spaces. The components to be placed are 
packed in known manner in packaging tapes 9 
wound on reels 7. The packaging tape 9 comprises 
a carrier tape 1 1 with compartments and a covering 
tape 13. The covering tape 13 is removed from the 
carrier tape 11 and the components accommo- 
dated in the compartments may be taken from the 
carrier tape 1 1 in a feed position 15. The compo- 
nents are taken from the feed positions 15 and put 
on the printed circuit board 2 by a transfer mecha- 
nism 17. The transfer mechanism 17 comprises a 
slide 19 which can be displaced in an x-direction 
and a pick-up device 21 which is also constructed 
as a slide and which can be displaced in a y- 
direction. The pick-up device 21 is provided with a 
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number of manipulators 23 which are capable of 
picking up components by means of an underpres- 
sure and which are each rotatable about a z-axis 
which is transverse to the x- and y-directions. A 
mc e detailed description of such a device 1 which 
is suitable for placing components on a printed 
circuit board 2 can be found in European Patent 
92292. The manipulators 23 are positioned in the 
pick-up device 21 in a pattern which corresponds 
to the pattern of the feed positions 15, so that the 
manipulators 23 can pick up components simulta- 
neously. The device further comprises an imaging 
device 25 which is situated between the feed posi- 
tions 15 and the printed circuit board 2. The imag- 
ing device comprises a known video camera, a 
flash gun and an optical system (not shown). Pic- 
tures can be taken by the camera 25 of objects 
which are present in the image field 27 situated 
above the camera. 

Fig. 3 shows a pick-up device 21 which cor- 
responds to a device as described in detail in a 
European Patent Application Publication EP-A1 
0434156 by Applicant (Application no. 90203353.9). 
Each cylindrical manipulator 23 is rotatable about a 
centreline 29 and arranged coaxially in a holder 31 
which is connected to a frame 33. Each manipula- 
tor 23 is provided with a coaxially situated channel 
35 in which an underpressure can be generated, so 
that the manipulator 23 can pick up a component. 
The pick-up device 21 is further provided with a 
reference member 37. The reference member 37 is 
a notch provided in a frame 33 of the pick-up 
device 21 , which notch is essentially black and on 
which white marks 39 are provided (see Fig. 4). 
The positions of the marks 39 relative to the ma- 
nipulators 23 are measured and stored in a control 
system (not shown). 

The operation of the device 1 is now briefly 
explained. The transfer mechanism 17 with the 
manipulators 23 is brought to above the feed posi- 
tions 15 by the control system. Components are 
picked up simultaneously or one by one by the 
manipulators 23 by means of an underpressure. 
The manipulators 23 are then displaced in the y- 
direction through the image field 27 over the cam- 
era 25. The moment a manipulator 23 is present in 
the image field 27 of the camera 25 the flash gun 
is triggered and a picture of the component held by 
the manipulator and of a portion of the reference 
member 37 situated in the vicinity of the manipula- 
tor is taken. The movements of the transfer mecha- 
nism 17 and the manipulators 23, the camera 25 
and the flash gun are controlled by the control 
system. A picture is taken of every component in 
this manner. A picture may be obtained of each 
component carried by a manipulator 23 and a 
portion of the reference member 37 in a short time 
since the pictures of the components are taken 
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while the manipulators 23 are moving over the 
camera 25, without each manipulator 23 having to 
be stopped in the image field 27 of the imaging 
device 25. Deceleration and acceleration forces on 

5 the components are avoided by this, and displace- 
ments of the component relative to the manipulator 
23 as a result of these forces are prevented. 

The reference member 37 may also be con- 
structed as a plate which is fastened to the frame 

w 33 and which is provided with marks against a 
contrasting background, which plate is directed 
transversely to the centrelines 29 of the manipula- 
tors 23. 

Fig. 5 shows a diagrammatic picture of a com- 

75 ponent 41 and a portion of the reference member 
37 fastened to the frame 33. The connection sur- 
faces 43 of the component 41 and the marks 39 of 
the reference member 37 are clearly visible. It is 
stored in the control system where the camera 25 

20 is situated relative to the device 1, where the 
reference member 37 is situated relative to the 
manipulator 23, as well as a model picture of the 
connection surfaces 43 of the component 41. The 
position of the reference member 37 relative to the 

25 camera 25 at the moment at which the picture was 
made can be determined from the picture made, 
after which the position of the manipulator 23 can 
also be determined. The position of the component 
41 relative Jo the camera 25 at the moment at 

30 which the picture was made can also be derived 
from this picture. When the positions of the ma- 
nipulator 23 relative to the camera 25 and of the 
component 41 relative to the camera 25 are known, 
the position of the component 41 relative to the 

35 manipulator 23 is implicitly known as a result. This 
relative position, however, need not be separately 
computed. The control system then determines the 
angular rotation and the displacements to be car- 
ried out by the manipulator 23 in such a way that 

40 the component 41 is placed on the printed circuit 
board 2 in the desired position. 

Other known imaging devices such as, for ex- 
ample, linear CCD cameras, photocameras, or laser 
scanners may be used instead of a video camera. 

45 Fig. 6a shows a second embodiment of a de- 

vice 50 according to the invention which is suitable 
for placing components 51 with connection wires 
53 in holes 55 in a printed circuit board 57. A 
device similar to a device 50 but without the main 

so characterizing feature of the invention (reference 
member 65) is described in detail in a European 
Patent Application Publication EP-A2 0432848 by 
Applicant (Application no. 90203234.1). The device 
50 comprises a robot 59 which is provided with a 

55 manipulator 61 which can pick up components by 
means of grippers 6 3. The manipulator 61 is pro- 
vided with three legs 65 which act as reference 
members. The robot 59 is controlled by a control 
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system 67. The control system 67 is provided with 
information about the movements to be carried out 
by the robot 59 by a computer 69/The device 50 
is further provided with an imaging device 71 (Figs. 
6b, 6c) which comprises seven light sources and 
seven light sensors. A light beam emitted by the 
light source is detected by a light sensor cooperat- 
ing with this light source. The operation of the 
device 50 is as follows. The component 51 held by 
the manipulator 61 is moved through the imaging 
device 71 by the rob ot 59. The legs 65 of the 
manipulator 61 interrupTthe light beams 101, 102 
and 103, so that the light sensors temporarily re- 
ceive no light. The moments at which the light 
beams are interrupted are stored in the computer. 
The moments at which the connection wires 53 of 
J thft r.nm ponent 51 interrupt the light beams 104, 

105 and 106 are also stored in the computer. The 
light beam 107 is only interrupted if one of the 
connection wires 53 is too long, so that the com- 
puter 69 gives an alarm signs. /Vhe position of the 
component 51 relative to the manipulator 61 is 
computed by the computer 69 from the moments 
at which the light beams 101 to 106 were inter- 
rupted/This may be done in a manner analogous 
to that described in the cited European Patent 
Application Publication EP-A2 0432848 (application 
number 90203234.1) or in the already mentioned 
US patent 4553843. The position of the printed 
circuit board 57, the positions of the holes 55 and 
the expected position of the component 51 relative 
to the manipulator 61 are stored in the computer 
69. 

The displacement to be carried out by the 
manipulator 61 is computed from the position of 
the manipulator 61 the deviations of the actual 
position from the expected position of the compo- 
nent 51 relative to the manipulator 61, and the 
positions of the holes 55 in the printed circuit board 
57 in such a way that the connnection wires 53 can 
be inserted in the holes 55 of the printed circuit 
board, upon which the component 51 is placed on 
the printed circuit board 57. The position of the 
printed circuit board 57 relative to the manipulator 
61 must be exactly known in order to obtain a 
correct placement of the component 51. The exact 
position of the imaging device 71 relative to the 
manipulator 61 and the printed circuit board 57 
need not be known because this position plays no 
part in the determination of the position of the 
component 51 relative to the manipulator 61 and 
the printed circuit board 57. 

A picture of the component and of a reference 
member coupled to the manipulator is used both in 
the determination of the positions of manipulator 
and component relative to the imaging device and 
in the determination of the position of the compo- 
nent relative to the manipulator. Both methods can 
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be used with the devices described above. When 
determining the positions relative to the imaging 
device, the position of the imaging device relative 
to the device must be exactly known. 

5 

Claims 

1. A method of placing a component on a printed 
circuit board whereby a manipulator carrying 

w the component is displaced relative to an im- 

aging device and the component is brought 
into an image field of the imaging device, after 
which the position of the component is deter- 
mined by means of the imaging device and 

is subsequently the component is put in the cor- 

rect position on the printed circuit board by the 
manipulator, characterized in that a picture of 
the component and of a reference member 
coupled to the manipulator is made by means 

20 of the imaging device, after which the positions 

of the component and the manipulator relative 
to the imaging device are determined from this 
picture. 

25 2. A method of placing a component on a printed 
circuit board whereby a manipulator carrying 
the component is displaced relative to an im- 
aging device and the component is brought 
into an image field of the imaging device, after 

30 which the position of the component is deter- 

mined by means of the imaging device and 
subsequently the component is put in the cor- 
rect position on the printed circuit board by the 
manipulator, characterized in that a picture of 

35 the component and of a reference member 

coupled to the manipulator is made by means 
of the imaging device, after which the position 
of the component relative to the manipulator is 
determined from this picture. 

40 

3. A method as claimed in Claim 1 or 2, char- 
acterized in that a picture is made by the 
imaging device while the component carried 
by the manipulator and the reference member 

45 coupled to the manipulator are being moved 

through the image field of the imaging device. 

4. A device suitable for carrying out the method 
as claimed in Claim 1, 2 or 3, provided with an 

so imaging device and at least one manipulator 

which is displaceable relative to the imaging 
device, characterized in that the device is pro- 
vided with a reference member which is coup- 
led to the manipulator. 

55 

5. A device as claimed in Claim 4, characterized 
in that the device is provided with a number of 
manipulators, while the reference member is a 
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common reference member which is coupled 
to all manipulators. 

6. A device as claimed in Claim 4 or 5, character- 
ized in that the reference member comprises a 5 
plate which is provided with at least one mark. 

7. A device as claimed in Claim 4 or 5, character- 
ized in that the reference member comprises a 
number of legs. w 
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